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Abstract. A new class of fully discrete Galerkin/Runge-Kutta methods is constructed and ana- 
lyzed for linear parabolic initial boundary value problems with time dependent coefficients. Unlike 
any classical counterpart, this class offers arbitrarily high order convergence while significantly 
avoiding what has been called order reduction . In support of this claim, error estimates are proved, 
and computational results are presented. Additionally, since the time stepping equations involve 
coefficient matrices changing at each time step, a preconditioned iterative technique is used to solve 
the linear systems only approximately. Nevertheless, the resulting algorithm is shown to preserve 
the original convergence rate while using only the order of work required by the base scheme ap- 
plied to a linear parabolic problem with time independent coefficients. Furthermore, it is noted 
that special Runge-Kutta methods allow computations to be performed in parallel so that the final 
execution time can be reduced to that of a low order method. 
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1 Introduction. 


In this paper, linear parabolic initial boundary value problems with time dependent coefficients 
are considered. Specifically, the goal is to construct and analyze fully discrete approximations to 
the unique solution u(x, t) of: 

d t u — -L(t)u in fi x [0, t*] 

(1.1) < u = 0 on dfix[0,t*] 

u(x,0) = u°(x) in fi, 

where: 

N 

L{t ) u = - X) a *,(4y( x > + A)(x,t)u. 

*,J=1 

Here, fi is a bounded domain in Tl N with dfl sufficiently smooth. Also, £,y(x,t) and to (x, i) are 
assumed to be smooth. Further, on fi x [0,t*], the matrix {4j}£y =1 is symmetric and uniformly 
positive definite and to is nonegative. Also, the initial data u° is assumed to be both sufficiently 
smooth and compatible, and precise hypotheses on the required smoothness of the solution u are 
made as needed. 

Now, for 1 < p < oo and integers s > 0, let W t,p = IF* ,p (fi) represent the well-known Sobolev 
spaces consisting of functions with (distributional) derivatives of order < s in L p = L p ( fi). Also, 
let || • ||w»,p denote the usual norm. Then, in particular, take H’ = W t>2 and denote its norm by 
|| • || 4 . In addition, let Hq be the subspace of H 1 consisting of functions vanishing on dfi in the 
sense of trace. Further, let the inner product on L 2 be denoted by (•, •), and the associated norm by 
|| -||. Next, given Hilbert spaces H , Hi, and Hi, B{H\, Hi) represents the Hilbert space of bounded 
linear operators from Hi into Hi, and B(H) = B(H,H). Also, for ti > ti, C l ([ti,ti],H) denotes 
the Banach space of operators, continuously differentiable to order / > 0, from [ti, £ 2 ] into H. See 
Adams [l] for more details. 

Now for each t € [0,t*], let L(t) be extended to be Z^-selfadjoint with domain H 2 d Hq- Also, 
assume that for / > 0 and m > 0 sufficiently large, L(t) € C*([0, t*],B(H m+2 n Hq, H m )) so that: 

(1.2) ||£ (0 (iMU < c(l, m)||v|U +2 Vv € H m+ 2 fl H% 

where L^ l \t) = D l t L{t). Note that here and throughout this work, c (sometimes with a subscript) is 
used to denote a general positive constant, not necessarily the same in any two places. Moreover, if 
in a given (in)equality, there is a crucial element upon which c is meant to depend, such dependence 
is indicated explicitly as in (1.2). Next, introducing the L 2 -selfadjoint solution operator T(t) for 
which T(t)L(i) = I on H 2 n H& and L(t)T(t) = / on Li, assume that for /> 0 and m > 0 
sufficiently large, T(t) € C'flO, t*],B (H m , H m+2 n Hi)) so that: 

(1.3) ||T«(t)t;|| m+2 < e(l, m)||v|| m Vv € H m 

where T^(t) = D|T(t). Finally, assume that for sufficiently large / > 0 and m > 0, the solution u 
and the data u° satisfy: 

(1.4) sup ||d|u(t)|| m < c(m,/)||u 0 || m+2 {. 

0<Kt* 

For details connected with (1.2)-(1.4), see Sammon [lbj. 
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A rough description of the results now follows. For this, let h and k denote spatial and temporal 
discretization parameters respectively, and suppose that Ug is a fully discrete approximation to 
u(nk) obtained according to the base scheme (1.38) described below. Now, in section 3, the error 
committed by (1.38), is shown to satisfy: 

(1.5) 0<n<n* ^ “ tt "H ^ ^ + ktM + hk ^ + h2k ^ l )\\ U °\\« 

where a = max(r + 1,2/i + 2), /i = min(i/,g + 1), q is the number of Runge-Kutta stages, and 
r and v represent respectively, optimal exponents, characteristic of the Galerkin method and the 
Runge-Kutta method upon which the fully discrete scheme is based. Note that under the mild 
condition that either r < 2/i or h 2 < ck y the above error is 0(h r + k M ). Further, it is explained 
below that the methods which are most easily implemented have the property that u < q+ 1 which 
makes the estimate optimal. It is also worth mentioning that inverse properties (associated with 
the use of a quasi-uniform triangulation of ft) are never explicitly assumed, and as explained after 
Lemma 3.8, the constructions of section 2 are required for this. 

Next, section 4 deals with (1.46), a variant of the base scheme which incorporates a precondi- 
tioned iterative method (PIM) for the time stepping equations (1.40). Specifically, these equations 
are solved only approximately at the nth time level with say, l n outer iterations (4.5), and j n inner 
(PIM) iterations (4.11), and it is shown that the above convergence rate can be preserved while 
keeping ^-X^nJo 1 f njn bounded independently of h and k. Hence, the order of work is asymptot- 
ically as that for a linear parabolic problem with time independent coefficients. Additionally, in 
[14], semilinear and quasilinear problems are considered, and the latter are treated with methods 
such as those reported here to obtain comparable results. 

It should also be mentioned that the discovery of the methods described below was fortuitous. 
Note that there are extrapolation options other than (1.35) which are apparently more natural. 
For example, D l could be replaced by T l in (1.35) since the latter is consistent with (1.39). This 
idea is considered together with (1.39) in a computational section. However, under rather general 
conditions, (1.5) is proved and demonstrated computationally only for (1.38) and (1.46). In fact, 
it has been reported by many authors ([7], [13], [8]) that unless the solution to the differential 
equation satisfies very restrictive conditions, a classical fully discrete scheme fashioned after (1.23) 
cannot be expected to offer optimal order convergence. Furthermore, with regard to efficiency, 
(1.39) requires the formation of q new stiffness matrices at every time step. On the other hand, 
(1.38) and (1.46) require only the formation of a single such matrix and, at the expense of at most 
100g" 1 % more storage, the recall of p — 1 of its counterparts formed at previous time steps. 

In [7], Crouzeix analyzes (1.39), and with Butcher’s conditions C(p — 1) and B(v)> [5] he 
establishes the L 2 estimate: 

o< max $ || U£ - u n || = 0(h r + k min M). 

Since 0(h r + k u ) has not generally been observed experimentally, this suboptimal phenomenon has 
been called order reduction . Note further that this L 2 estimate depends upon the assumption that 
the stages are computed exactly. On the other hand, in [13], Karakashian considers approximating 
the stages with a PIM, and proves that the above estimate holds while the order of work is kept 
optimal. Also, he constructs collocation type implicit Runge-Kutta methods (IRKM’s) for which 
p = 1 / — q + l. Nevertheless, such methods have limited stability for q > 3. In fact, there is a 
general trade-off among IRKM’s in the sense that the more stable methods suffer more from order 
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reduction while those which do not suffer so, are not as stable. However, when (1.39) is modified 
as in (1.38), it is possible to achieve high order even for very stable methods. For example, in 
section 4, an algebraically stable IRKM is used for a problem of the form (1.1), and optimal order 
convergence is obtained with (1.46) but not with a counterpart based on (1.39). 

Douglas, Dupont and Ewing [10] have analyzed Galerkin/Crank-Nicholson fully discrete approx- 
imations for a class of quasilinear parabolic problems, proving an optimal L i estimate for a method 
which is second order in time. Also, this rate was shown to be preserved by an algorithm in which 
the time stepping equations are solved only approximately with an optimal order of work. Then 
studying (1.1), Bramble and Sammon [3] have obtained similar results for some Galerkin /O brechkoff 
fully discrete approximations, proving optimal Li estimates for methods up to fourth order in time. 
Finally, note that in [9], Dougalis and Karakashian analyze Galerkin/Runge-Kutta fully discrete 
approximations for the Korteweg-De Vries equation. In fact, they prove optimal Li estimates for 
some modified IRKM’s which are up to fourth order. Hence, the spirit of their work is similar to 
that of the present study. 

In the remainder of this section, there is a presentation of material relevant to the spatial and 
temporal discretizations considered here, which concludes with a precise definition of the schemes 
for which the above claims are made. 

Spatial Discretizations 

To make the following machinery more definite, consider the Ordinary Galerkin Method for the 
spatial approximation of the solution to (1.1). Let D(t) (•, •) be a bilinear form defined by: 

N 

D(t)(v,w) = [iij{t)d Xi v,d x .w) + (£o(t)t>,«/) v,w G H%. 

i 

Next, let Sh represent an approximation subspace consisting of continuous, piecewise polynomials 
of degree < r — 1, vanishing on dCl. Then, take Th[t): Li — ► to be an approximation to the 

solution operator T(t) defined by: 

D(t){T h (t)w,x) = (tn,x) Vw G Li, Vx 6 S h . 

For more examples of Galerkin methods satisfying the assumptions enumerated below, see Bramble, 
Schatz, Thomee, and Wahlbin [4], and Sammon [16], [17]. 

Depending on the Galerkin method used for the spatial approximation, let He be a linear space 
equipped with a norm || • ||jg and satisfying the following properties. Suppose H 2 n Hq C He and 
that: 

(1.6) Nil < c\\v\\ E 

(1.7) IMI E < c\\v\\i Vv G H\ 

For example, for the method described above, take He = Hq. Now let {Sfc}o<h<i be a family of 
finite-dimensional subspaces of He satisfying the following for some integer r > 2: 

(1.8) inf{||t»-x|| + %-xlU}<^|HI. VvGirntfo 1 , 2 < s < r. 

Then suppose that for each t G [0, t*], a corresponding family of operators {7\(t)}o<h<i is given 
satisfying: 
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i. Th(t ) : L 2 —> ► Sh is selfadjoint, positive semidefinite on L 2 , and positive definite on S/,. 

ii. For 0 < h < 1, T^(i) 6 C l ([0,t*],B(L2,£j»)) for Z > 0 sufficiently large. 

iii. For 2<s<r,0<t<t* } and Z > 0 as large as required in the sequel: 

(1.9) |||r<‘>(«) - rf (i)H + a||(tW (0 - rf (OHIe < <**||«||.-, v. e h -\ 

Hence, the restriction of Th{t) to Sh is invertible and its inverse is henceforth denoted by Lh(t). 
Since L/,(Z) is also positive definite and selfadjoint on Sh, both L^(t) and T E (t) have square roots 
but it is also assumed that: 

(1.10) «I|T* (*HI < c\\Tjj (i)ty|| jg; < ||w|| < ||u>||js Vtu € L 2 , 

(i-ii) llxll < HxlU £ c ll L /i Wxll < <W(0xll* V X € S h . 

Also Lh(t) G C*([0, **], B(<Sfc)) for Z > 0 sufficiently large and in fact, Bales [2] has proved that for 
0 <s,t<t*, and Z > 0: 

( 112 ) Il4wrf WiJWxll < 4011x11 v x s s k , 

(1.13) l|Ijho4‘ ) W r » (OHI s «(0MI WeL,. 

Then using the selfadjointness of these operators, the following are straightforward consequences 
of (1.12) and (1.13). For 0 < s,t < t*: 


(1.14) 

||T^(s)4(i)xll<« 

VxePft, 

(1.15) 

ll4oW(tWI < «IMI 

Vv G L2> 

(1.16) 

l(4°( a )x,x)l < c(l)(L h (t)x,x) 

Vxes*. 

In addition to ( 

1.16), assume that for 0 < t < t* and Z > C 

): 

(1.17) 

I(4 ,) (0x.«I<c(0IIxIIeIWIIe 

Vx> <t> e s h . 


Next, defining the elliptic projection operator as Pjs(Z) = Th[t)L(t), it follows from 
that for 0 < t < t*\ 

(1.18) ||[7 - P E (t) HI + h\\[I - P £ (Z)HU < ch’\\v IU Vv € H* n Hi 2 < 

In fact, with u>(t) = P E {t)u(t) and rj(t) = u(t) — cu(Z), (1.2), (1.4), and (1.9) can be used [3] to show 
that: 

(1.19) sup {||/l(()l| + kll/’MIlrf < c*'||u°|| S+2 1 2 < a < r, 0 < 2 l < a - a. 

0 <t<f 

Finally, it can be shown that Pq = Lh[t)Th(t) is for every t € [0, i*], the orthogonal projection of 
Z >2 onto Sh and that T/,(i) = T^(Z)Po. Then, since / — Po is majorized by I — P E in L 2 , it follows 
from (1.18) that: 

(1.20) ||(/ - Po)v|| < ch s \\v\\ t Vveff'nFo 1 , 2<a<r. 


(1.9) and (1.2) 
a < r. 
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Now, (1.1) has the following semidiscrete formulation. Find u h : [0,t*] 


f d t u h = -Lh{t)uh 

\ Mo) = M 


Sh satisfying: 


where G Sh is a suitable approximation to u°. In [17], Sammon analyzes approximations of the 
form (1.21), and with assumptions comparable to those described above, he proves an optimal L 2 
estimate: 

sup || u(t) - u A (t)|| < ch r ||u°|| r . 
o<t<t* 

In the present paper, semidiscrete approximations are not analyzed. Instead, (1.21) serves only as a 
source of inspiration for fully discrete approximations, and u/, is not even mentioned in forthcoming 
proofs. 


Temporal Discretizations 

For the temporal approximation of the solution to (1.21), Implicit Runge-Kutta Methods 
(IRKM’s) are now introduced. Given an integer q > 1, a q-stage IRKM is characterized by a 
set of constants {6y}y =1 , and {r,}®_ 1 , and it is convenient to make the following defini- 

tions: 

A = {a.j}?,y=i, fcT = {h,h, B = d,ia^{6,}, 


M = BA + A T B-bb T , T = diag {r,}, e T = (1,1, . . . ,1). 

For the IRKM formulation used in this work, choose arbitrarily, to G R, yo € R n , F : R n+1 — ► R n 
sufficiently smooth, and k > 0 sufficiently small, so that for to < t < t 0 + k, smooth functions 
y , y : R — » R n are well-defined by: 


| D t y{t) = F(t,y(t)) 
\ y(^o) = yo, 


(1.23) 


y ’(*) = yo + (t - t 0 )^aijF(t 0 + Tj(t - to),y j {t)), l<j<q 

j=i 

q 

y(t) = yo + («-to)5Z 6 * F ( f o + 7 '*'( t-f o),y < (t)). 


v ,= 1 

The method is described as explicit if a,y = 0, ,• < j and implicit if for any *, an ^ 0. Also, it is said 
to have order v if for every y and y defined as above, D l t y(to) = D l t y(to), 0 < l < u. Butcher [5] 
has developed simple conditions for the above parameters which guarantee a given order; however, 
only the following is explicitly required in this work: 


(1.24) 


l\b T A} 1 e — 1 1</<i/. 


To see the roots of condition (1.24), let (1.22) have n = 1, to = 0, yo = 1, and F(y) = —y, so that 
y(f) = e~ *. Then, from (1.23), y(t) = r(t ) where r(z) is a rational approximation to the exponential 
e~ z given by: 


(1.25) 


r(z ) = 1 - z'b T {l + zA) 1 e. 
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Expanding this expression shows that r(z) is a i/th order approximation to the exponential if and 
only if (1.24) holds. Next, with regard to stability, an IRKM is said to be Ao-stable if: 

(1.26) |r(z)| < 1 Vz > 0, 

and strongly Ao-stable if: 

(1.27) sup |r(z)| < 1 Vzo > 0. 

2>2o 

Also, a method is called algebraically stable if M and B are positive semidefinite. However, if an 
algebraically stable method is irreducible (not equivalent to a fewer stage method) then: 

(1.28) B is positive definite, and M is positive semidefinite. 

One other notion of stability which is useful here is that of dissipativity: 

(1.29) - 1 < -1 + 5 < r(z) < 1 Vz > 0. 

Ao-stability is required of all IRKM’s considered in this work. However, in order for the ap- 
proximations to decay with respect to the time step, strong Ao-stability must hold. In fact, to 
guarantee decay, both (1.27) and (1.28) are assumed. Then in section 4, the iterative scheme (1.46) 
described below requires at least (1.29) in addition to: 

(1.30) r(z) < 1 - Vz > 0. 

This growth condition is extremely mild and this author is unaware of any popular IRKM which 
fails to satisfy it. Also, requiring (1.29) and (1.30) improves on a related result of Karakashian [13] 
in which (1.27) is used. Next, note that the spectrum of A, <r(A) is related to the poles of r(z) and 
in addition to the above, it is assumed throughout this paper that: 

(1.31) <r(A) C (x e R : x > 0}. 

Returning to the temporal discretization of (1.21), let a q-stage IRKM of order v > 1 be given. 
Assume also that there exists a q x q matrix D satisfying: 

(1.32) D[e\ Ae; . . . ; A q ~ 1 e } = [Ae; 2A 2 e; . . . ; qA q e}. 

Again, this author is unaware of any well-known IRKM for which such a D fails to exist. In fact, 
the so-called collocation type methods are those for which D = T. Now with n = min(i/,g + 1), it 
follows from (1.32) and (1.24) that: 

(1.33) lAD l ~ x e = D l e 1 <1<H~1, 

(1.34) lb T D l ~ x e =1 1 < / < m- 

Next, for 0 < n < n* - 1, n*k = t* , let the real values be chosen distinctly, so that the 

q x q matrices are well-defined by: 

(1.35) EC(C)' = ^' 0</<M-l 

m—0 
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as the computation of their components involves the inversion of the /i X n Vandermonde matrix 
{WtfJCLo- addition, assume that these parameters are bounded independently of n: 


(1.36) 




Actually, it is clear below that the natural and computationally advantageous choice for (1.35) is: 


c = 

m 


{ m/ n, 0 < n < (i — 2 
-m, n - 1 < n < n* 


- 1 . 


In any case, define t n = nk and r^ = t n + S^k, and for 0 < n < n* — 1, 0 < t < t*, and 0 < 8 < k, 
let the following be defined on S/, = 


£»(<) = diajKMt)}, £l = wn JK*) = £rt 2l = 2j(t). 

Now with: 

(1.37) U% = {I + kL^-'PolI + kL°]u° 

suppose that for 0 < n < n* — 1, the approximation € S/, is given, where Ufi « u n and 
u n = u(x,t n ). Then, let £f£ +1 « u n+1 be given by what is henceforth called the base scheme: 


(1.38) 


= eVZ-kAlm 

U£ +1 = (7 -b T A- 1 e)U£ + b T A- 1 U£ 


where U% € S/, is well-defined provided [7 + kAC^] is invertible. Here, A££ for example, is 
understood in the sense of composition of operators defined on S *. Note that if the temporal 
discretization of (1.21) were accomplished as prescribed by (1.22) and (1.23), the following would 
result: 

{ U£ = eU£ - kACZ&Z 

where £% = diag {£&(*" + fcr<)}. 

U£ +1 = (7 - b T A~ l e)U£ + b T A~ l U£ 1 -‘- 9 

However, as discussed in the beginning of the Introduction, (1.38) is designed to improve upon 

(1.39) with the indicated modification. 

Now, with regard to iterative approximations, note that an efficient method is needed for solving 
the time stepping equations: 

(1.40) 

According to (1.31), A can be transformed as follows: 

SAS -1 = A = diag {A,} + subdiag {0,-}; A,- >0, 1 < i < q; 0,- = 0 or 1, 2 < * < q. 

l<t<q 

Then Vj" ta Ufi can be obtained by the (outer) iterations: 

(1.41) [7 + kMftiSVr) = {SeU n + kSA(CZ - = R? !</</„ 
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where: 


(1.42) Vq = E (-l)-- 1 J* + j iff 


1 < n < n* — 1, 


w=n~l- p n \ / 

r n, n = 0 

(1.43) l n = • /i+1 — n, l<n</u 

1, /i+l<n<n*-l, 


Vo° = eU° h , 


0, n = 0 
Mn = ' » — 1, 1 < n < /j 

/i, fi+ 1 < n < n* — 1, 


and (1.41) is started with Vq* = Vq provided are computed as indicated below. 

Now consider the simple but important observation that if: 

(1.44) A i ± Ay, * # j and 0,- = 0, 2 < * < q, 

then the block system above decouples into the following equations which can be solved in parallel: 

[I + k\iLl](SVr)i = (R?)i 1 <*•<*. 

Then, to avoid having to factor new coefficient matrices at every time step, a preconditioned 
iterative method is used to approximate Vj” with (inner) iterates, say {^”}o<i<j„- Further, it is 
shown that there exist integers such that: 


(1.45) 


1 n * -1 

“7 E ln ^ n - c 


while the convergence order (1.5) is preserved for what is henceforth called the iterative scheme: 


(1.46) 


U H = V£y B 


( U£ +1 = ( I -b T A~ 1 e)U£ + b T A- 1 U 
Finally, let the initial approximation for this scheme be given by (1.37) also. 


2 The Product Space Operators. 

In this section, the machinery elaborated between (1.2) and (1.20) is generalized to analogous 
operators defined on products of spaces on which their precursors are defined. Also, various techni- 
cal lemmas are proved for later use. Now, in addition to S/,, define the product spaces L 2 = [L 2 ] 9 , 
Hq = [f?o] , > Hg = [He] 9 , and H m = \H m \ q . Also, denote the natural product space norms by: 

11*11* ={!>*>*, ll*IU = <Ell*fc}i, and ||»|| = ||*||o. 

i=l i=l 

Then, for 0 < n < n* — 1, 0 < t < t* and 0 < s < k, let the following be defined on H 2 D Hj: 


C(t) = diag {£(*)}, £" ee C(t n ), £"(*) = E r m^(<" + O). = £"(*). 

qX9 m= 0 
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The first step is to construct, for 0 < n < n* 
satisfying: 

' C n {s)T n (s) = 

( 2 . 1 ) 


- 1 and 0 < s < k, operators T n (s) ( T n = T n (k )) 
I on Ii 2 


{ T n (s)l n (s) = I on H 2 n Hj. 

Note that with the following defined on L 2 for 0 < t < t* and 0 < n < n* — 1: 


T (t) = diag{T(t)}, T n = T (t n ) 

9x9 

T n (s) cannot be taken as a combination of such operators unless D is diagonal. 

Lemma 2.1 For 0 < n < n* - 1, C n {s) e C*([0, fc], 8 (H m+2 Pi Hj, H m )) where Z,m > 0 are as in 
(1.2). Also the following hold: 


(2.2) l|d!2“Mv||m < c((,m)||v|| m+2 

(2-3) ll[2“W - 2"WU < c(m)t||v|| m+J 

Vv € H m+2 n Hj, 0 < s < k, and 0 < n < n* — 1. 

Proof. The crucial observation is that by (1.35) with / = 0: 

M - 1 /•«'»+£'** 

2"(«) - Z n = V I?[£(f" + 6?s) -C n }=Y' I? / ’ £W{i)dt 

*=o *=o Jtn 

and (2.3) follows with (1.36) and (1.2). Also, (2.2) follows using (1.36) and (1.2). ■ 

Theorem 2.1 Let m,l > 0 be as in (1.8). Then for k small enough, and 0 < n < n* — 1, there 
exist operators T n {s) € C , ([0,fc],£(H m ,H m+2 nHj)) satisfying (2.1) and: 


(2.4) 


||d'T n (s)v|| m+2 < c(/,m)||v|| m 


Vv € H r 


Proof: Let v € H m be chosen arbitrarily, and define 7: H m+2 D Hj — ► H m+2 fi Hq by: 

7u = T n {v + [C n - £"(s)]u}. 

By (1.3) and (2.3), with k small enough, there is an e € (0, 1) such that Vui,U 2 G H m+2 n Hj: 
\\7 (u 2 - ui )|| m+ 2 < c(m)||[£ n - £ n (s)](u 2 - ui)|| m < e||u 2 - ui|| m+2 . 


Hence 7 is a global contraction and has a unique fixed point. Thus, for every v G H m , there 
exists a unique element T n (s)v € H m+2 n Hj such that £ n (s)T n (s)v = v. In particular, the first 
part of (2.1) holds. Also, if u € H m+2 D Hj and w = T n (s),£ n (s)u — u, then by the uniqueness, 
C n (s ) w = 0 implies that w = 0. So, (2.1) follows. Next, the following estimate is well-known: 

/ ||T n (s)v- r n V || m+2 < (1 - e )- 1 ||7T'*v - T n v|| m+ 2 . 

\y (1.3) and (2.3): 

ll/TV - 7"v|| m+ 2 < c(m)||[£ n - £ n (s)]T n v|| m < c(m)fc||T"v|| m+2 . 
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Then, for the case 1=0, (2.4) follows from the last two inequalities and (1.3). Now, by estimating 
difference quotients, it can be shown in a straightforward way that d a T n (s) = —T n (s)d t C n (s)T n (s) 
for 0 < 8 < k and the smoothness of T n (s) follows inductively with Lemma 2.1. Finally, after 
differentiating the first line of (2.1): 


= - 





and (2.4) follows inductively using (2.2). ■ 

Now with trivial modifications of the above, the following is obtained for the adjoints. 

Lemma 2.2 For 0 < n < n* - 1, £ n (s)* G C , ([0,*],B(H" ,+2 nHj,H m )) where /, m > 0 are as in 
(1-2), and: 

(2.5) ||ai£ n (s)*v|| m < c(l, m)||v|| OT+2 Vv G H m+2 n Hj. 

Furthermore, with m,l > 0 as in (1.8), there exist operators T n (s)* G ([0, k], B (H m , H m+2 riHj)) 

satisfying: 

(2-6) ||diT"(s)*v|| m+2 < c(l, m)||v|| m Vv G HT. 

and £"(s)*T n (s)* = I on L 2 , T n (s)*£"(s)* = I on H 2 n Hj. ■ 


The next step is to construct for 0 < n < n* — 1 and 0 < s < k, operators T h n (s) (T fc n = T l ( l (k)) 
satisfying: 

f l n h (s)Tf(s) = Po on L 2 


(2.7) 


i T h n (s)C” h (s) = I 


on S fc 


where Po = diag(Po). Note that with the following defined on L 2 for 0 < t < t* and 0 < n < n* — 1: 

g-xq 


Tk(t) = diag{T fc (t)}, T h n = T h (t n ) 


T fc n 


(s) cannot be taken as a combination of such operators unless D is diagonal. 

Now let {Dh(t)(- ,-)}o<t<r be a family of bilinear forms defined on He x He so that: 


(2.8) D h (t)(x,4) = (L k (t) X ,4>) Vx,^ e s h . 

More specifically, with D^\t)(-, •) = D l t Dh{', •)> assume that for 0 < t < t* , l > 0, and 2 < m < r: 

(2.9) |. {t){v,w) - (L W (t)v,tv)| < c(/)h m_1 ||v|| m ||u; - u||e, 

Vv g H m CiHl, Vw e H 2 n Hi + s h , Vue^n^ 1 , 

(2.10) |£k ) (t)( w > v )l ^ c (0IMMMb Vw » v G h e , 

(211) e||xlli<^*W(x,x) V X €5*. 

For example, these assumptions are readily verified for the Ordinary Galerkin Method mentioned 
in the Introduction. For additional examples, see Sammon [16], [17]. Next, for 0 < t < t * , 
0 < n < n* — 1 and 0 < s < k, let the following be defined on He x He: 

Dh{t)(w,v) = ^( t )( u 't'»v»), A? (»)(w,v) = £ M tn + C«)( r >. v )- 

1=1 m— 0 
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Lemma 2.3 For k > 0 small enough, l > 0, 0 < n < n* - 1 and 0 < s < k: 

(2.12) W(s)(w,v)| < c(/)||w||e||v||e Vw, v € He 

(2.13) c||X|||<^( s )(X,X) VXe S fc . 

Proof. Using (2.10) and (1.36), (2.12) follows in a straightforward way. Then, by (2.12), (2.11) and 
(1.35) with 1 = 0: 

D?(s)(X,X) = P h (t n )(X,X) + [‘ D r DZ(r)(X,X)dT > c(l - k)\\X\\% VX G S fc 

Jo 

and (2.13) follows for k small enough. ■ 

Discrete counterparts to Lemma 2.1 and Theorem 2.1 appear next. 

Lemma 2.4 For 0 < n < n* - 1, ££(s) E C l ([0, k], S(S^)) where l > 0 is as in (1.18). Also, the 
following hold: 

(2 W) l|T» i W«tf»WT»*«*ll < c(/)||f|| 

(215) IIT.hOlr.W - i»((l)]T^(l)f|l < c\t, - l,|||f|| 

(2.16) II V(<)|2;m - rar^wfii < <*||f|| 

VfGL 2 , 0< Ml, *2 < t\ 0<s<k, 0 < n < n* — 1. 

Proof The manipulations required are similar to those needed for Lemma 2.1, except that (1.13) 
is used instead of (1.2). ■ 

Theorem 2.2 Let l >0 be as in (1.12). Then for k small enough, and 0 < n < n* — 1, there exist 
operators T fc n (s) € C*([0, k], 5(L 2 , S/,)) defined by: 

(2.17) W(s)(T h n (s)f,X) = (f,X) Vf € L 2 , VX€S h , 0 <s<k 
and satisfying (2.7) in addition to: 

( 2 . 18 ) l|9jr*"(.)f||* < c(i)||f|| 

(219) IlitWaiW^WXII <c(OI|X|| 

Vf G L 2 , VXgS/,, 6 u 9 2 =0,\ 0<t< t\ 0 <8<k, 0 < n < n* — 1. 

Proof That 7)”(s) is well-defined by (2.17) follows from Lemma 2.3 and the Lax-Milgram Lemma 
[6]. For (2.7), note first that by (2.8), for X, $ G S 

j>M(x, *) S £ p h (t n + 0)( W •) = £ (**(«" + 0 )C x, *) = (£;*(s)x, *). 

m=0 m= 0 

Combining this with (2.17), it follows that VX, h and Vf G L 2 : 

UtWW.*) = PfMCV (»)*.*) = (f,x) = (P„f,x). 


li 


5»WCVM«M*.*) = (2SW*,#) = W»)(®,*)- 

Then (2.7) follows after setting X = [£/Ks)7J, n (s) — Po\i, $ = T ft n (s)£^(s)'S r and using (2.13). Next, 
to obtain (2.19) for the case that / = 0, set E = (7^ n )^[££ — ££(s)](T h n )^ so that by (2.16): 

||[/-£]X||>(l-cfc)||X|| VXGS*. 


Hence, for k small enough: 

4‘(*)VW£»w = i - jrMra^wi- 

If = 0 2 = the first case of (2.19) follows with (1.14) and (1.15). Otherwise, (1.10) is 
used. Now by estimating difference quotients, it can be shown in a straightforward manner that 
d s T^(s) = — T h n (s)5«£^(s)T h "(s) for 0 < s < k, and the smoothness of T h n (s) follows inductively 
with Lemma 2.4. Next, after differentiating the first part of (2.7): 


rfMa'.VMtfW = -E (!) I4‘ WVW^MlIT^W^rswr^MIl^W^.WJrfWl 


so (2.19) follows inductively using (2.14). Finally, by setting Oi = 0 2 = 0 and X = P<$ in (2.19), 

(2.18) follows with (1.11) since T£{s) = tj”(s)££(s)7), n (s) = T^’{s)Pq. m 

Next, certain inequalities related to (2.9) are needed. 

Lemma 2.5 For k > 0 small enough, the following hold: 

(2.20) W* n («)(v, w) - (dU"(s)v, w)| < c(/)A m '- 1 ||v|U||w - v\\ s 

(2.21) (s)(w,v) - (w,d‘£ B (s)*v)| < c(/)h m_1 ||v|| m ||w - u|| £ 

(2.22) | Z ( • ) «. w WW([^T*w - a*T^(s)]f,X)| < c(/)h”*- 1 ||f|| m _ 2 ||X - u\\ E 

Vv€H m nHj, Vw € H 2 n Hj + S A , VueH 2 nHj, VfeH m , VXeS h 2 < m < r, /> 

0 , 0 < 5 < fc, 0< n < n* - 1. 

Proof. First, note that: 


M-l 


«iJ>f W(v,w) - («ji"(*)v,w) = Ewn'tafV + <M(r?v,w) - (£ w (<” + «r«)r?v,w)] 


«=0 


so (2.20) follows with (2.9). Also, (2.21) follows similarly. For the remaining inequality, the key 
observation is that by (2.17), the left side of (2.22) is equal to: 

- (f,x)]| = |aJ[Arw(T"(.)f,x) - (£“«f »f,x)|| 


and (2.22) follows using (2.20) and (2.4). ■ 

The groundwork for a generalization of (1.9) is now complete. 
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Theorem 2.3 For k > 0 small enough, the following holds for 0 < n < n* — 1, 0 < s < k, / > 0, 
and 2 < m < r: 

(2.23) \\d l a [T"(s) - fMMI + A||a*[T"W - T h n (s)]v \\ B < c(/)h”*|MU-2 Vv e H m ~ 2 . 

Proof. With 2 < m < r, let v € H m-2 and define Xj £ Sh to be the closest to d l s T n (s)v in the 
norm || • ||js. Then, define: 

e 1 = a‘ [T» - r*"(«)]v = [a‘T"(»)v - x,] - [air,"(s)v - x,] = e 1 0 - e {. 

By (1.8) and (2.4): 

Poll < c(/)^ m - 1 ||v|| m - 2 . 

Next, by (2.12) and (2.13): 

c\\E l h ||| < K(s)(E l h ,E l h ) = DZ(s)(E l 0> E l h ) - D£(s)(E l ,E l h ) < c\\E l 0 \\ E \\E l h ||j + |TO(^,4)I 


By (2.22), with ill-defined sums understood to be zero: 

l»*"W(B‘,4)l = E ( J ) a ‘. • < P»*W(b‘.4) - E ( ‘i ) tir'K Wte 1 . 4)1 

< c(0f.”-'||v||„-2i|E' 11 k + <Mll*Dl®V 

t=0 

So, the indicated estimate for follows inductively from the last three inequalities. Now, a 

duality argument is used to complete the proof. Define Xj € S& to be the closest to T n (s)*i£* in 
the norm || • \\e . Then, with ill-defined sums understood to be zero: 



By (2.21) and (2.6), Fi satisfies: 

ifii + m < c(o»ii^iEii«'ii* 

t=0 

while the case for Fz follows with (2.12), (1.8), and (2.6). Then, by (2.22), (1.8), and (2.6): 

\Fz\ < c(0^ m_1 l|v||m- 2 ||x; - T n ( s yE'\\ E < c (oniv|U-2p‘l|. 

Finally, by (2.5) and (2.6): 

ini^OMElMl. 

»=o 

Now (2.23) follows inductively. m 
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3 The Base Scheme. 

In this section, the base scheme (1.38) is analyzed for the approximation of the solution to (1.1) 
and (1.5) is established. That the stages are well-defined depends on the next lemma. 

Lemma 3.1 Provided (1.81) is satisfied, [/ + kAC%] is invertible, and for k small enough, 
[/ + kA£%] is as well. Also the following hold: 

(3.1) IKWB'ir+fctrsr'xii < c]|x||, 

(3.2) ||(«;) , ‘[/ + *Aj;]- 1 (M!j’)' , X|| < c||X|j, 

(3.3) H(Ma , '(7 + lrA£r]- 1 («M' , X|| < c||X||, 

VXGS h , O<0<1, 01,02 = O,|; 0 1 = -0 2 = ±§, 0 < m < n*, 0 < n < n* - 1. 

Proof. The invertibility of [/ + kAZ £] and the estimate (3.1) involve a spectral argument after A 
is transformed to Jordan form, and the details are provided by Karakashian [13]. Now set: 

E 1 = [I + kAZl]~'kA{Zl - It) and E 2 = kA{Zl - ll)[I + fcA^]" 1 

so that: 

(£S)J[7 + iA2;](T k “)i = (7 + fcAj:2][7- (£2)t®,(V)»|. 

(V)*17+ fcA22)(£2)i = [7 - (T k *)tft(rS)*][7 + kACH 

By (3.1) and (2.16): 

||(£2)lB,(V)ix|| + ||(T»*)t*(£I)lx|| < c*:||X|[ VX <E S„. 

Hence, for k small enough, [I + kAZ £] is invertible. Next, for 02 — 0, ±|: 

(kZt^il + kAltr^kZtY 2 = [I- (Ct^E^T^r^kZtY^ + kAZt}- 1 

and (3.2) follows for 0i = For 9\ — 0, ± 

(W;)''U + *A2a- 1 (WJ)i = (A:i:;)‘' + i[7 + l:A£a- 1 [7-(r i ")i£ 2 (£;)i]- 1 

and (3.2) follows for 0 2 = \. Now, for the case 0i = 02 = 0, with XgSj, chosen arbitrarily: 

l|X|| 2 < i||[/+A:A£M 2 + |||X|| 2 + fc|(A^X,X)|. 

Then with = (££)*X, by (2.16): 

l(A£fcX,X)| < |(A*,*)| + |((T fc »)i[2g - 2Jf](T fc “)**,A r *)| < c( 1 + k)(ZtX,X). 

Also by (3.2) with 0i = |, 0 2 = 0: 

||(fc^)iX||<c||[/ + A:A£OT| 


14 


and the remaining case for (3.2) follows after combining the last three inequalities. Finally, using: 

(3.3) follows with (1.14), (1.15), and (3.1). ■ 

Now, for the sequel, let the following be defined: 


r = c^-<y\ 

r^ = /-fc6 T ^[/+fcA^]- 1 e, 


T) n = U n - 0J n y 


i = kb T ll\I + kAlfi-'e, 


M-l l 

u n (s) = Y D l ed\u n -, (0 <s<k) u n = u n (fc), 

m=0 ** 


a; n (s) = f A n (s)2 n (s)u n (s), (0 <s<k) u n = u> n {k). 

After some straightforward calculations, the following error equation is established: 

n-l 

r +1 = ZU n + kb T ll[I + kAll\~ l {u n - eo>" - kAY ed t oj(T^)} 

m= 0 

- k^A-^I+kAl^APoY^m^mW ~ ««(»£)] 

m= 0 

(3.4) - kb t A~ 1 [I + kAlft-'AY r m e5 t{[ p B(C) - ^oMC)} 

m= 0 

M-l 

- {o> n+1 - U) n - kb T Y ^m e ^ w ( r m)} 

m= 0 
4 

= = Zkt n + 'l> n 0 < n < n* — 1. 

i=i 

Now, stability is to be established in the following norms, which according to (1.11) are well- 
defined for 0 < n < n*: 

(3.5) lllxllln = {(X» X) + k{L£x> x)}* X^Sh- 

Also, from (1.16) with / = 0, it follows that these norms are equivalent: 

(3-6) dlllxllL < lllxIL < «WL V X€S», 0 < m,n < n*. 

As in section 2, let the following be defined in the natural way for the product spaces: 

11*11 = (*,*)* 

*=1 

im.-<£i»ie>* xe s». 
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Finally, (3.17) follows after using (3.7) and (1.26) in: 

Next, (3.15)-(3.17) are used to obtain (3.13). Suppose that e 2 is small enough that C2 < 1. Then, 
assume that fco > 0 is small enough that if 0 = (1 — ci)/(l + c 3 fc 0 ) > 0, then C2 + 0 > 1. Next, 
multiply (3.17) by 0 and add the result to (3.16). With C5 = c 2 + 0 — 1 > 0, and 0 < k < ko'. 

+ (i + c)ii(*«)**Ke“U* < iirni- 


By (1.11), there is a C6 > 0 such that: 


Also, by (2.15), with x" = (AtiJJ) ^ 

ll(fc£j 4 ' 1 )**S<“ll s = llx”|p + ((r»)i( £ h +1 - i!l(rf)*x“.x”) < (1 + cr*)l|(MI)**ir 


From the last three inequalities, it follows that: 


(1 + c 6 *)u*;:rii 2 + (1 + | C5 )(i + e T fcr i ii(fc£^ i ) i *s€"ii 1 < iiinii;. 

So assume that ko above, is also small enough that (1 + jC5)(l + C6&o) -1 (l + C7&0) -1 > 1 + ®i> for 
some £1 > 0. Then (3.13) follows for some c E (— ce,0). ■ 

The next two lemmas are useful in subsequent consistency estimates. 

Lemma 3.3 Let to, ti, *2 £ [0, t*] and |t 2 — ti| < ck. Then, for integers m,l > 0: 

(3.18) sup l|Lfc(*o)aiw(t)|| < c(Oll« 0 || 2 (i+i) fl = 0 »| 

0 <t<r 

(3.19) \\E\\ < c(l){k m+1 + fc 2 m|u°|| 2 l, E = / tS (t 2 - t) m d l Mt)dt. 

Jti 

Also, there exist E\ and E 2 such that E = E\ + E 2 while: 


(3.20) 


(3.21) || kL h { 

Furthermore, for 0 < n < n* : 


pL„(to)M|| < c(/)hfc m+ ? +, '||u°|| 2( , +l) 
\\kL h (t 0 )E 2 \\<c(l)k m ^%°\\ 2{l+i) 


i = 0, 1 
* = 0 , 1 . 


(3.22) M| n < c(l)(k m+1 + hk m+ h + /i 2 fc m )||u 0 ||2,. 

Proof. By (1.6) or (1.17), (1.7), (1.19) and (1.4), for 0 < t < t*, and 0 = 0, 

\\L e h (t 0 )d l Mt)\\ < c||a{ w («)IU < c\\d l Mt)\\E + c||a{u(i)|| 2 < c(i)(h + i)||u°|| 2(l+1) 
which gives (3.18). Next: 

E={h- t 1 ) m a'- 1 r ? (f 1 ) - mj\t 2 - t) m - l d\- 1 r){t)dt + j'\t 2 - t) m d\u{t)dt 
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and (3.19) follows with (1.19) and (1.4). Now, define: 

Ex = [ t3 (t 2 - t) m d l t [u(t) - P E (t 0 )u(t)}dt 

Jtl 

= -(t 2 - - P s (*o)u(ii)] + m f h (t 2 - - P E (toHt)]dt, 

r*> , tl 

E 2 = / (t 2 - t) m P E (t 0 )d\u(t)dt 

J ti 

= -(*2 - h^Psi^d^uitx) + mf \t 2 - t)" l - 1 P £ (io)a{- 1 u(t)dt. 

Jti 

By (1.17), (1.19), (1.18), and (1.4), for t = 0, 1: 

||[fcL fc (io)]*i?i|| < ck m+ * +i sup {p'- 1 + S(i)IU + ll[/-^(<o)]a|- 1 + ‘«(t)|| B } 

o <t<t* 

< c(l)k^h<h\\u% [l+i) . 

By (1.2) and (1.4), for t = 0, 1: 

\\kL h (t 0 )E 2 \\ < ck m+1 ^ sup ||I(t 0 )a{- 1+ ‘u(t)|| < c(/)fc”*+ 1 +*||«°|| 2(w) . 

o<<<<* 

Now, since E = E\ + E 2 , (3.20) and (3.21) are established. Finally: 

(hLlE.E) < l||(tLS)^i || 2 + |||(ti,J)i£|| I + \\\kL" h E,tf + |||E|| S 
and (3.22) follows after combining this with (3.19)-(3.2l). ■ 

Lemma 3.4 The following hold for 0 < s < k, and 0 < t < t* : 

(323) lirlWaio’WII < «ll““lli. 0</<(.-l, t> = 0,\ 

(3.24) Ko“WII + *ll4(0W«)ll < ^Il«°ll2.. 

Proof. From (1.17) or (1.6), (2.18), (2.2), and (1.4), it follows that for 0 < l < /x — 1 and 9 = 0, |: 

\K(t)diu> n ( s )\\ < ctoEll^VW^l^W^Wlll* * ‘(OEElia^W^HII 

*=0 t=0jf=0 

< c(OEEll*r« B « m " i lh < c(0II«°IUm 

j=0m=j 

which gives (3.23). Now, since d%u n (s) = 0, from (2.23), (2.2), and (1.4), it follows that: 

iwo-toil = liar |o“w - u“wiii < eEiiar'itrw - r-(.))a<|2*(.)«“(.))ii 

*=0 

< e^sil^-w^wil < ^ 2 EEii a r« n « m - J 'il2 < ch 2 iitt o ii 2M . 

»=0y=0 ;=0m=i 

The remaining component of (3.24) follows similarly, after using (1.17) first. ■ 

The order of consistency is established in the next four lemmas. 
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Lemma 3.5 ip* of (8.4) satisfies: 

(3.25) IIIV-riL < Ck{k? + hk m ~ * + ^fc'*- 1 )||«°|| 2( , +1) . 

Proof. First, it is proved that: 

(3.26) d'w n (0) = D l ed[<jj n 0 < / < n - 1. 

Now, the result of differentiating £^(s)w"(s) = Poi n (s)u n (s) is: 

£[E r m(%y-i ( j. ) 4'~V+o)3;*"(s) = 

t=0 m= 0 V / 

+ SZs^Diediu"^-. 

»=0 m=0 V / j—i l*' /* 

Letting s — *■ 0, with (1.35), it follows that for 0 </</* — 1: 

££d^"(0) = Pof^D 1 -* ^ j £( J -)(t n )L>’ea’ U n - £l>'-‘ ( J ) ^a _ °(*”)^^>"(0). 

Then (3.26) follows inductively with: 

£*«<"" = ftE ( J. ) £('-■) - E ( J ) 

which results after differentiating Lh{t)u>(t) = PoL(t)u(t). Therefore: 

rib 


_ e(J n = Y^ D l ed l tU n^_ + ^ £ = _L J\ k - s )^ d ^(s)ds. 


1=1 


Next, by (1.35) and (1.33): 

**- 1 #*- 2 m-i jui m-2 . I+i 

AA^T^ed^) = kAj2[J2 T X) l ]ed l t +1 u n - + F = ^AD^d 1 ^— + F 


m= 0 


/*- 1 


/=0 m=0 


= £>ed{ W "^- + F, 

l=i *• 




(M- 2)! 


J=0 

T £ e f ro (c - ty-*d?u{t)dt. 

m=0 Jtn 


Now define: 


l; = A:H r A- 1 [/ + A : A£2]- 1 (^)^(r fc ")^~(T fc ")5[(^)^]. 

so that by (3.2), (2.14), and (3.24): 

ML < e*i||(£J)*2S|| < ck»+* sup ||(£Jf)iar^WII < cA*'* + *||«°||a M . 


0<s<k 


Next, by Lemma 3.3, let F = Fi + Ft where with (1.36): 
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and: 

Ml. < c(*» + hk“-k + 

Then, define: 

F = 6 T A-‘[/+tA2;]->(M;)U(r 4 ")i|2;-^|(7.“)i[(t«)iF| 

+i T >l- 1 [/+*:A2j|- 1 (i£»)M[(l;2J)5fi] + 6 , 'A- 1 [7 + *A2j]- 1 X[J;2SF2l 

so that by (3.2), (2.16), and the last three inequalities: 

III? III. < <*M. + «ll(M»**ill + •liwjftll < <*(** + + k 2 *'‘- 1 )||«°|| s( „ +l) . 

Now since ip” = E — F, (3.25) follows. ■ 


Lemma 3.6 rp% of (8.4) satisfies: 

(3-27) ML < =t“ +1 |l« O |l20. + l). 


Proof. Define v(s) = C”(s)u”(s) so that with ill-defined terms understood to be zero: 

ai»W = E ( ' ) E rilK) , - , 2< l -'>(i" + 0)IIE 

»=0 \ / m=0 j=i W 


Letting s — 1 0, with (1.35) and (1.1), it follows that for 0 < / < /z — 1: 

«i»(0) = E ( I ) [ErL(C) w lDLL(‘-<)(i“)a 1 '«" = -dL 9‘ +i «". 

t=0 \ / m— 0 


Hence: 


l n u” = -J2 D l ed l t +l u n ^ + E, E = * f\k - s)' i - 1 dj*t>(s)ds. 


1=0 


Next, by (1.1) and (1.35): 


ErJUWtfeuWM = -£rMu(r”) = -ElE r -( 5 my]ea| +1 « n ^-F 

m =0 m =0 1=0 m=0 

H-l 1 1 1 M-l 


. k l 


= V^- - F, F = t— E r”e f >£ - t)»-'d? +1 u{t)dt. 

1=0 *• m=0 *' ,n 

Hence by (3.2): 

Now, by (2.2) and (1.4): 


Kill. < <*(MI + 11*11)- 


M < ck» £ sup ||ar‘2"M«i«"MII 2 <*'Ell a .'«"ll> 2 s*'ll“°ll=». 

l =0 0<t<k ,_ 0 
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Also, by (1.36) and (1.4): 


Ill’ll < ck>i SU P l|9t‘ +1 «(t)|| < cfc|ju°|| 2 ( M+1 ) 

0<t<f 

and (3.27) follows from the last three inequalities. ■ 

Lemma 3.7 of ($4) satisfies: 

(3.28) Kill. < cM'||u°||. +! . 

Proof. By (3.2) and (1.36): 

Kill. < - -PoMOIII < «*E<ll a *'HC)ll + IIU - J > o]a,«(C)||> 

m=0 m= 0 

and (3.28) follows with (1.19), (1.20), and (1.4). ■ 


Lemma 3.8 of (S. 4) satisfies: 

(3.29) |||tf|||» < ck^ + + h 2 /s / * _1 )||u 0 || 2 ( M+ i). 

Proof. First: 

u n+1 - u n =f2d l t u n ifi + E, 

i=i ' 

By (1.35) and (1.34): 

“ T i;rj«a.a.(c) = S T &;us;;)Vi +1 ""V +F = E lTD ‘^‘* 1 ^ 1 Tr+ F 

m=0 1=0 m=0 ’ i=0 

“E^jr+f. F s 7-ttti X> T r~'/>S - O'-'dr "(<)*• 

i=l *' L l‘ m= 0 Jt " 

Hence t/)J = —E + F and (3.29) follows after applying Lemma 3.3 to E and F, and using (1.36) to 
obtain inequalities of the form (3.22). ■ 

With the consistency complete, it is now appropriate to discuss the development of the tech- 
niques used. First, it is possible to construct an error equation alternative to (3.4) which circumvents 
the constructions of section 2. However, this requires inverse properties. For example, one option 
involves the following replacements: 


t ft n+1 

E=±- (t n+1 - t) # ‘af +1 o;(t)df. 

H'. Jr* 


1 . 2+1 


H-l 


1.2+1 


E D l ed l t oj n ^, V>2 


i=0 


kfA-'lI+kAlfl-'A E r” £h(C)[u> n - ew(C)]. 

nt=Q 


Then in the proof of Lemma 3.6, v(s) is changed to ^(s)u n (s), and bounding derivatives of the 
latter involves bounding products of the form L^\s)T^\t). This can be accomplished using inverse 
assumptions as demonstrated by Bales [2]. 
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Also, the original idea for overcoming the suboptimal convergence rates mentioned in connection 
with (1.39), was to find q X q matrices with which the following would lead to optimal 

convergence estimates: 


u-l 


ECK)' = »I, 


m=0 


2* = E c 2»(i" + c*) «< E 

m =0 1=0 *• 


However, attempts to prove an optimal order of consistency have repeatedly led to the following 
conditions for the matrices {A}feo ■ 


Doe = e; D,Dje = Di+je, 0 < i,j,i + j < v - 1; lADi- \t = Die, 1 <1 <v — 1. 


Consider for example, adapting the proof of Lemma 3.5. Unfortunately, even though the number 
of unknowns matches the number of constraints in the equations above, it is shown in [14] that 
they can be solved only if v < q + 1. 

Now, (1.5) is established in the following for (1.38). 

Theorem 3.1 Under the conditions of Lemma S.l and either Proposition 8.1 or 8.2, 0 are 

well-defined by (1-87) and (1.S8), and the following holds: 

(3.30) ^max^ \\Uf( — u”|| < c*(h r + k 11 + + /i 2 fc M-1 )||u°|| a . 

Also, unless c < 0 in (8.9), c* depends exponentially on t*. 

Proof. Set E = [(h r + + hk ""i + h 2 Jfc'‘- 1 )||u°|| a ] 2 . Then, combining (3.9), (3.25), (3.27), (3.28) 

and (3.29) for (3.4): 

|||r +1 |||’ +1 < (1 + SftJIHHll + dkE 0 <»<«*- 1. 

After dividing this by (1 + ck) n+1 and summing, the result is: 

< (i + afc)”iue°iiio + “ii^r‘1 1 - n + o < n < »•. 

Now, according to (1.37), [J+fcL^J^ 0 = [Po-Pg]u°. So with (1.20), (1.18) and a spectral argument, 
it follows that: 


(3.31) |B«°||J < c||[P„ - J$]«°||||[/+ < c'> r H«°llr. 

Then, (3.30) follows with (1.19) and the last two inequalities. ■ 


4 Iterative Approximations. 

In this section, the iterative scheme (1.46) is analyzed for the approximation of the solution to 

(1.1) , and (1.5) is established. First, a brief discussion of Preconditioned Iterative Methods (PIM’s) 
is given. See Hageman and Young [ll] for more information. 

Let H be any finite-dimensional Hilbert space equipped with an inner product (•, -)tf and an 
associated norm || • ||# • Also, let Q: H — ♦ H be if-selfadjoint and positive definite, and suppose 
that an approximation is required for the solution x* to: 

(4.1) Qx * = b. 
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Then, suppose that Qo : H —* H is .H-selfadjoint and positive definite, and that solving: 

(4.2) Q 0 x = b 

is relatively inexpensive. Furthermore, assume that Q and Qo are equivalent: 

(4.3) Pi{Qox,x) h < ( Qx,x)jj < Pi{Qqx,x)h Vx e H. 

The operator Qo is called the preconditioner and the PIM’s of interest in this work are those with 

the following properties: 

i. If (xj}y_ 0 are given approximations to x* of (4.1), then calculating xj + 1 only involves com- 
puting Qx, Qox, (Qx,x)h, and (Q 0 x, x)h for certain x € H, and solving equations of the 
form (4.2). 

ii. There is a smooth decreasing function a\ (0, 1) — ► (0, 1) such that a(l) = 0 and if (4.3) holds, 
then: 


( 4 - 4 ) HQo ( x * - x )\\\h ^ ^(pi/piWWQo [x* - x 0 ]||jf. 

For example, the Preconditioned Conjugate Gradient Method satisfies the above properties, and it 
is popular for having <r(s) = (1 — \/s)/( 1 + \/s) as opposed to say (1 — s)/(l + s), which is offered 
by various other PIM’s. 

Now, the rough discussion prior to (1.46) is expanded with more details. First, suppose that 
for 0 < n < n* - 1, the approximations {U™}'£ l =o have been computed using methods described 
below, and recall that an efficient procedure is needed for computing Ufi defined by (1.40). Next, 
let Vq denote an initial approximation to Ufi given as indicated in (1.42). Now, instead of actually 
computing {V’j n }o<i<i„ as suggested by (1.41), proceed as follows. Let a sequence of positive integers 
{jn}”-^ 1 be specified. Then, suppose in an inductive fashion, that for 1 * VZ-iJ. has been 
computed from j n PIM iterations as prescribed below, and let Vj n be defined by the outer iteration: 

(4.5) [/ + *A££](SVn = {SeU n + kSA(C jf - 2JI)V £ ijJ 1 < / < /» 

with the understanding that V£ Jn = Vq. Letting n and / be fixed, (4.5) can be written in the form: 

(4.6) [I + - kOiL^i - i 1 < * <q 

where t/>o = 0, V** = (£Vj n )j , 1 < i < q, and according to (1.35) with / = 0: 

(«•*> *< = + ms £ r” us - 

m= 1 

The natural preconditioning for (4.6) involves [/ + kL^] which, according to (1.16) and (1.31), is 
equivalent to the operators of (4.6), i. e., for 1 < * < q and 0 < n < n*: 

(4.8) Pi([ I + k L 0 h]x,x)<{[I + KLh}x,x)<P2{[I + kL 0 h \x,x) V X € S h . 
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Now, to cover the case that A is not diagonalizable, define xpi with: 

(4.9) [/ + kXiL^i = <f>i - kOiLWti 1 < * < q 

where t/>j* = 0. Also, to obtain t/>?” for 1 < t < q, set = (<S Vj" x Jn ),- and let iterates {V’/}o<j<j„ 
be given by a PIM with preconditioner [ I + kL^]. Then as (4.4) follows from (4.3), from (4.8) it 
follows that: 

(4-10) |||& - #|«o < c[a{pi/ p 2 )] ] \Ui - 

Finally, take 'F = {ifii,ip 2 , . . . ,^q) T and 'F* = (ip{,rp 2 , • • • , *Pq) T so that Vj n = S* 1 # and inner 
iterates for (4.5) are defined by: 


Vo = V 1,„ 


1 <j<3n. 


(4.11) 

Now the next objective is to show that: 

(4.12) \\\UZ - V„lllo < (C*+ c[a( pi /p 2 nuz - Vx,yJllo 

Then, given some £o > 0, j n is chosen so that: 

(4.13) \\\UZ - Vil lllo < MWZ - Vi,i„ lllo !</</« 

where: 

(4.14) 


l > 1 . 


R 2 < f ck 2 , 0 < n < p 

Pn ~ \ e 0 t n+1 , 0 < n < n* - 1. 


From the last three inequalities, it follows that the integers {in}^^ 1 ma y he chosen to satisfy 
(1.45) as claimed in the Introduction. First, the outer iterations (1.41) and (4.5) are shown to be 
well-conceived. 

Lemma 4.1 With UZ given by (1.40), the following holds: 

(415) HIV. - Vi|||o < cfc|||f?J - Vi||o 

for every Vi,V 2 e S/, satisfying: 

[I + kAZl\V 2 = eUZ + kA{C n h - £E)Vi. 

Proof. Since: 

uz-v 2 = [/+ kACZ}- l (kCZ)U{T h n )s[£Z - ll\{T£)*{kiz)*(uz - Vi)- 

(4.15) follows with (3.2), (2.16), and (3.6). _ ■ 

The next lemma shows that {Vj”}j>o converges to Vj n at a rate which reflects (4.10) whether 

or not the right sides of (4.6) and (4.9) are the same. 

Lemma 4.2 With V t n , Vj " n > an< ^ V, 9^ ven h (4-5) and (4-H) : 

(4.16) Hi V - iiio ^ c i<r(pi/piY& III' V - Voiiio- 
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Proof. Letting <r= cr(pi / p 2 ) 5 with (4.10), it follows that: 

IllV’i - V'illlo < lll&-#lllo + lll#-#lllo < IllV’i - V’.'lllo + cff*|||# - # ? ||| 0 

< (1 + ca’)\\\rl>i - V'illlo + c^'HIV'i - V'i’Hio- 

Subtracting (4.9) from (4.6), with (3.6), (1.31), and a spectral argument, it follows that: 

IllV’i - Mil < c|||[/ + UiLX]- 1 fc0,^(V',-i-^" 1 )|||^ 

< c({[7 + kLl\{kLl)[I + kXiL^UkL^H^i-i - (W)Hti-i - fci)) 

< IllV’i-i - V’i^illlo 1 <*<? 

Now, the last two inequalities give: 

IllV’i - #1110 < c\Hi-i ~ #- illlo + c<r jn \\\'Pi ~ # ? ||lo 

from which it follows recursively that: 

IllV’i - #1llo < c ° ln YL IllV'm - V’mlllo- 

m= 1 

Then (4.16) follows after recalling (4.11) and that V) n = S -1 ®. ■ 

Finally, (4.12) is established in the following. 

Lemma 4.3 With Uft defined by (1-40), the sequence {Vj” n }i>o satisfies (4-12). 

Proof. Applying Lemma 4.1 to (4.5): 

ini'.” - vy-lllo < ctllpf - v,l, J|„. 

Using this with (4.16) and (4.11): 

lift” - v,3J|| 0 < ciT ,n n|vj n — v|J||lo = c.Hll^-ifcijlio 

< c<7'»{|||pf-viio + |||pf-^ u j|| 0 > < ccHck + -v,a lA || 0 . 

Now, (4.12) follows after triangulating with V". m 

The next objective is to show that the convergence rate (1.5) can be preserved even when 
{inJn-o 1 are chosen so that (4.13) and (4.14) hold. So additional stability and consistency argu- 
ments follow. First, define: 

f" = UR - u n and V n = ££<*> n ~ <*> n+1 

where ip n is as in (3.4). Now, according to (1.46) and (1.38): 

K" - = b T A-\v; - Oft, 
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so it follows that: 
(4.17) 


f n+1 = + <l> n ~ b T A-\UZ - Ug). 


By (4.13) and (1.46), (Ug — Ug) can be estimated in terms of (Ug — Vo*)- So, the error equation 
(4.17) is supplemented with the following one, which is obtained from (1.40) and (1.42) after some 
straightforward calculations: 

= 


£ (-i)”- 


A*n + 1 


[/ + kAlfl-'kAlli - l£)[I + kAl^X-'es™ 


+ [i+kAiz)-' £ (-I)*— if _£_ 1 )[* m+ 1 -r] 

m=n—l—fi n \ / 

- £ ^ ) (?»” - up) 

m=n— l-/in V / 


£ (-i)' 


m=n— 1— /in 


Mn + 1 


(4.18) 


- * £ (-i)"- 

m=n— 1— Mn 

- * £ (-!)”■ 

m=n-l— n n 

+ £ (-i)”-’ 

m=n-l-n„ 


Hn + 1 


Mn + 1 


Mr» + 1 


[I + kAll\~'kA{ll - l£)[I + kAl I?]" 1 

M - 1 

x{Q m — eu> m — fcAy^rf t e^ta>(r/ n )} 


[/+ fcA2^]- i APoS r r^(»r)[ om - eu ( r Di 


[/+ kAlZ)- l APo 52 T?d t {[PE{Tr) - Po]u(rr)} 


[7 + kAll}- 1 £ (-1)""” 1 ( **"_ + * ) {u> m - ew* - kAj2r?edtu(Tr)} 


m—n~ 1— 


= £ep 


1 < n < n* - 1. 


Before analyzing these error equations, a few adjustments must be made in Propositions 3.1 and 
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3.2 for the following stronger stability inequality: 


(4.19) 


k n+1 Hln + l < (1 + Ck)\\\r\t - coim/ - ffflh-llli + - U fc "||| 2 


+ck[{h r + k>* + hk^-s + /i 2 ifc # 1 - 1 )||u 0 || a ] 2 


0 < n < n* - 1. 


Proposition 4.1 Let (1.29) be satisfied. Then there are constants Co > 0 and c, such that (4-19) 
holds. In fact, c < 0 if (1.27) holds and c(l) of (1.18) is small enough. 

Proof. By the same manipulations leading (3.10), for (4.17) it follows that: 

(1 - c 3 fc)|||r +1 ||| 2 n+1 < Hlrfrlli + + ck- l W£ - U£\\\l + C Ar 1 |||V>"||| 2 n . 

By (1.26), I - has a square root. Hence, taking x n = [I + kL^g n , with (1.29) it follows that: 

= Ml 2 - ([/ + >•?][/ - rj] i>r, [/ - rJTlix”) < lb-in - m - x”). 


Using (3.12), there is a c < 0 such that: 


-([/-r£]x n ,X n ) < x") + |(1 + cfc)||x n || “ llx n || = i^llk n |||» “ Ul 1 ~ r £lx n , X n ) 

where c < 0 if (1.27) holds. Now with c > |<5c + c 3 + e~ 1 C\, and cq = \8, (4.19) follows after 
combining (3.25), (3.27), (3.28), (3.29) and the last three inequalities. ■ 

As with Proposition 3.2, c < 0 is guaranteed for (4.19) by the following. 

Proposition 4.2 Let (1.27) and (1.28) be satisfied. Then, there are constants Co > 0 and c < 0 
such that (4-19) holds. 

Proof In the proof of Proposition 3.2, replace £” with f n , and ip n with ip n — b T A -1 (17£ — U £) . 
Then with e = |(c 2 — ci), redefine 9 = (1 — ci — 2e)/(l + c 3 ko) so that the last part of the proof is 
readily changed to give the following instead of (3.13): 

ll*!fl 2 + (1 + < (1 + »)llls*lli - «ll(*£S)h*ll 2 . 

As with (3.14), it follows that: 

llk n+1 llln + i < (1 + 2fc)llk n lll» - «(Mtff n ,* n ) + ck-^wuj) - ujf III 2 + ck-'iwrwil 

Next, since v > 1, r(0) = 1 = — r'(0). So, there is a Co > 0 such that for all z > 0, r(z) is greater 
that the linear function 1 — <^z, i. e., —ez < — 2co[l — r(z)], Vz > 0. Also, using (1.26), co can 
be assumed small enough that — e < — 2co[l — r(z)], Vz > 0. After multiplying the latter by z and 
adding the result to former, it follows that: 


-e{kL h x, x) < ~co{[I + kLl\[I - r£]x, x) 


VxGS/,. 


Hence, (4.19) follows with (3.25), (3.27), (3.28) and (3.29) and the last two inequalities. 
Now, estimation of the terms of (4.18) begins. 
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Lemma 4.4 {©"}f =1 of (4-18) satisfy: 

(4.20) e merit <c e {|iif” +i -nL+i«£'r-t'riiL>+c* E ir 

1=1 m=n- 1 -fin m=n-l-fi n 

Proof. First, note that: 

e?= E (-x)”-”‘(^_ + M[/ + M2a- , (MJ)^ 

m=n—l—u n \ J 


*(V)h(2l - Cl) + (Cl - C?) + (2” - 2r)Kt.”)j|(2») } (Tr) i ](*2r)^|/ + ‘^2Z‘]- , 'f”. 

So, 0 " is estimated using (3.2), (2.16), (2.15), and (1.15). Also, estimates for 8 £ and 63 follow 
with (3.2) and (3.6). ■ 

Lemma 4.5 {0”}f =4 of (4-18) satisfy: 


(4.21) 


E merit <cHh'+k“)\\Au- 


Proof. Recall E and F defined in the proof of Lemma 3.5. By (3.18), and (3.23): 

m 11 + iifii < cfci« o ii 2 („ +1 ). 

So ©J can be estimated using the techniques applied for the estimation of 0". Also, the same 
manipulations used to prove Lemmas 3.6 and 3.7 give corresponding estimates for 85 and ©g. ■ 

Lemma 4.6 0” of ( 4 . 18 ) satisfies: 


(4.22) 


l|e?lt < <*(**• + + A s *"“ 1 )l|t. 0 ||2(„+i). 


Proof By (3.26), for n — 1 — fi n < m < n — 1: 


oj m = E m + F m , 


and taking (m - n)’| m _ n= j =0 = 1 : 
m-i hi *~ l 


F m = 7 — jf (t-»)" ‘d;a m {s)ds 


E m = Eo‘4(L(m - n)‘ai +, w"| + G!*}, Gf> = 7^-4) £ (<” - t)^ l d^(t)dt 


1=0 i= 0 


Next, since: 


?= E (-!)”■”( C"- + m )(m- n )‘ = 0 0 <i<ii„ 


m=n-l- fin 
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it follows after some re-indexing that: 


V' / j\n-m / Mn + 1 

“ ' ' \ n - m 

m=n—l-n n \ 

E tjE 

i =0 i=i+Mn + l U 


n — m 


111 Y — djoj n k j + 


E (-I)"’” f ^ ) k'G™} 


where ill-defined sums are understood to be zero. Now, by Lemma 3.3: 

fcJ HI 5 t w "IL ^ cA^" +1 ||u°|| 2(m+1 ) Pn + 1 < j < P 

k l \\\Gr\L < Ck(k> + hk?-i + ft 2 ^- 1 )||« 0 || 2(/1+1 ) 0 < / < 


0 < l < fi — 1. 


Hence: 


m=n—\— 41 


: (-i)"-" ( ^ ) e”il < <*(*“■ + **•-* + fc i **‘- , )ii» o ib (M+ .). 


Also, by (3.24): 

|||*’ m |||„ < ck(hk»~? + /i 2 fc #i_1 )||u°|| 2 ( #1+1 ) n-l-/i„<m<n. 

Then (4.22) follows from the last two inequalities. 

Lemma 4.7 ©§ of (4-18) satisfies: 

(4 23) |||e;|||„ < ck(k“ + A ! *:'‘- 1 )||u»|b (M+1) . 

Proof. As in the proof of Lemma 3.5: 

i rk 

Q m - eoj m -kA^2 r = E m - F m , E m = _ / (Jfc - s^djfu^ds 

t=0 ^ 


u; m - euj‘ 


li-i 

> m -kAj2 r?ed t u ;(rf ) = - F m , 


and by (1.35): 

F ” ■ + CTTiJF «* - 1 )'‘“ la i +1 " 

First, using (3.2): 


r(t)dt = F™ + F 2 m . 


©Sills* E (ll«”ll + l|r.“ll) + 4 E (-!)"-»( ^“_ + M jptII- 

m=n— 1— /i„ m=n— 1— \ / 


,=n— 1— /i n 


Then, with (3.24): 

ll^ll < ch 2 P ||«°|| 2 M 

Also, by Lemma 3.3: 

< «*(*=“+ A s *^“ 1 )ii«°ii2(„+i) 


n-1- fi n <m<n. 


n-1- fin <m<n. 
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Finally, note that: 


) Fr =fw AD ’-'' 

{ £ (-»)—( n - m )C^m- £ (->)-”( C". + i ) «?•»->• 

m—n—Hn \ / m=n— 1— /i„ V / 


m=n—l—fi n 
X 


So, by (1.4) and (1.19): 

II £ ( C- + m ) S + t“)ll« 0 || !( „ + .)- 

771— n— l — fin \ / 


Now, (4.23) follows after combining the last four inequalities. ■ 

Next, the above lemmas are combined with (4.13) for the estimation of the term & -1 |ll^» — filin’ 
in (4.19). 

Proposition 4.3 With U£ defined by (1-40) and U% by (1-46), the following hold: 


‘■Vf-vfiii <«*-*/« £ {iiif'r-&r£+iik” + '-f"‘fc> 

(4.24) n _! m-n-l-n n 

+ckft Hint + «*[(* r + ^ + hk»-k + h 2 ^- 1 )||u°|| a ] 2 l<n<n*-l, 

m=n— 1— fi n 

(4-25) IIP? - Pjlllo < <*‘‘II“ < ’IU- 

Proof. By (1.46), (4.13) and (3.6): 

IIP? - PJIIIn < c*|||Pf- V 0 “|||„ 0 < n < n’ - 1. 

Then, combining (4.20), (4.21), (4.22), and (4.23) for (4.18) leads to: 

iipf-vb-ii. < £ {iiiPr-prim+iik” +, -riu+ct £ iinii 

m=n-l- n n m=n— l-/ir» 


+ck(h r + k*" + hk*-* + h 2 fc'*- 1 )||u°|| a 1 < n < n* - 1. 

From (4.14) and (1.43), it follows that: 

< cJfe* 0 < n < n* - 1. 

Finally, (4.24) follows after combining the last three inequalities. Also, by (3.2), (3.31), and (3.18): 

ll|p? - Vo°lllo < ‘iKIIIc, < clbllo + <fl"°lllo < «ll«°ll. 

and (4.25) follows after combining this with the two estimates above including the case n = 0. ■ 

Now, (4.24) demands an estimation of the differences !!|f n+1 - f re |!!n and this is the content of 
the following. 
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Proposition 4.4 If (1.29) and (l.SO) are satisfied, then the following holds: 

ciir +i - rue + ip - »-r 1 ]^ n+1 iiin+ 1 < Alikin 2 * + einojr - mil 

(4.26) 

+(1 + c s fc)|||[7 - r£]5f"||ln + ck 2 [{h r + k» + hk> i -* + fc****- 1 )||u°|| a ]» 0 < n < n* - 1. 

Proof. The following is established after some straightforward calculations: 

([/+ fc^ +i ][/+ r~ +1 ik n+1 - r\, k n+1 - r\) + ([ i+kL^i - rt +i ]r +1 ,r +1 ) 

(4.27) 

= 2([J + fc££ +1 ]k R+1 - r fc +1 ? n ]> k” +1 ~ ?"]) + ([7 + ^ +1 ][7 - r^ +1 ]f n , ?")• 

By (1.29) and (3.6), there is a ci > 0 such that: 

(4.28) ([/ + r; +1 ][/ + - {*]. [/ + - S "l) > 2c 1 |||f” +1 - 

Next, using (3.6): 

2|([/ + *£fc +I )lf" +l - r fc +, f"]> k n+1 - J"!)| < «llk” +1 - C VilJIt " H - f "III. 


< «iik n+l - + «im*i - hirin’ + « iiik +1 - rami 2 + niiim 1 - mi 2 .- 

Combining (3.25), (3.27), (3.28) and (3.29) for (4.17), it follows that: 

llk n+l - *&H. < ck(h' + k“ + hk“~ i + A I *:“- I )||u»|U + c|||fff - Sail.. 
Combining the last two inequalities with (3.7) and (3.8), the result is: 

2|([7 + kL n h +] l ]k n+1 - rf'n k n+1 - S n ))\ < cfc 2 ||klln + - ^ n |lln 

(4.29) 

+ck 2 [(h r + k» + hk*~k + h 2 ^- 1 )||u°|| a ] 2 + Cl ||k n+1 - (Till 2 • 

For the last term in (4.27), suppose first that (1.27) holds. After some calculations: 

(4.30) ({[7 + MjM][I-rJ«l - \I + kLl)\I- r;|}f“,t") = (E{kLi)i S ".{kL" h )i S ") 


where: 


E = (*l;)-*K - rj^KH?)" 1 + [pr)*ir , OT)*l(H*) i M - >-; +1 K‘£i:)' 


+ (3y)i|i”+ i -£»)(rai[/-ra. 

By (3.8), (2.15), (1.13), and (1.26): 

(4.31) ||f?xll < <*11x11 Vx€5 fc . 

Next, define r e (z ) = [1 + z\/{ 1 + (1 — e)z] with e > 0 small enough that with (3.11) and (1.27): 


< < 

(1 + ez)( 1 — Oz) 0 < z < z\ 

- < 1. 1 


(1 - e) _1 sup|r(z)| Z\< z 



. Z>«1 , 
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Hence: 


v* e s h . 


e(kLZx,x)<([I + kL n h }[I-rZ] X ,x) 

Combining this with (4.30) and (4.31): 

(4.32) mi + kL^I- rj* 1 ] - [I + kL n h ][I- rjj]}?",f")| < ce^I + kL n h ][I - rflf»f"). 

Finally, for the case that (1.27) holds, (4.26) follows after combining (4.28), (4.29), and (4.32) for 
(4.27). Now, assume that (1.27) fails, so that r(oo) = 1 — b T A~ l e = 1. Nevertheless, by (1.30) and 
(1.11), [I — r£] is positive and invertible, so define: 

f n = [I + fcLgHJ-rE) and F 2 = (kL n h )[I + kLft-% 1 . 


Then, instead of (4.30) , the following is used: 

({[/ + kLf'Wl - r£ +1 ] - [/ + Mfl[J - r£]}?", ? ") = 

(F[(fcl£)-* + (fc£J*)5][r n+1 - f n ][(kL n h )-? + (kL^}F~rkr,~rkr) 


(4.33) 


From (1.30), it follows that: 

(4.34) \\F X \\ < c||x|| V X eS„. 

Next, since b T A~ 1 e = 1 — r(oo) = 0: 

rjf = J- b T A~ 1 {(kACh)[I + kAZ^e = I + b r A~ 1 [I + kAZ^e 


and hence: 

? n = -b T A~ 2 e + b T A- 1 (A~ 1 - /)[/+ kAZl]~ l e. 

Therefore: 


»n+l 




-1 


e. 


So by (3.3) and (2.15), for 0\, 9 2 = ±j: 

||(fcLj) # M?M-i - rn]{kLt )°' X II < ckM V X e S h . 


Combining this with (4.34) for (4.33) gives (4.32) and hence (4.26). ■ 

Finally, the convergence result (1.5) is established for (1.46) as follows. 

Theorem 4.1 Let the conditions of either Proposition 4-1 or 4-2, in addition to those of Lemma 
S.l and Proposition 4-4 be satisfied. Then, can be chosen so that (4 -IS) and (4-14) hold 

and provided £q > 0 is small enough, the approximations {Ufi }™-. 0 obtained by (1.3 7) and (1-49) 

satisfy: 

(4.35) max \\U£ - u n || < c*{h r + k» + hk + h 2 A:'*- 1 )||u 0 || a . 

0<n<n* 

Also, unless c < 0 in (\.19), c* depends exponentially on t* . 
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Proof. Add ci|||£7£- Z7£|||^ to both sides of (4.26) and multiply the resulting inequality by ek 1 t n+1 . 
When this is added to (4.19), the result is: 

llk n+1 lln + i + c 1 efc- 1 t n+1 {|||f n+1 - f»||£ + re - ml) + ek-H»+'\\\{I - r?']?r +1 \t +1 
< (1 + ck + C 2 eA:t n+1 )|||f n |||^ + ck-'IWUh ~ Wit + c *P r + ^ + hk»~? + h 2 ^- 1 )||u°|| a ] 2 

+[ek-H"+\l + c 3 k) - c 0 ]|||[/ - rtfrlWl 1 <»<„*- 1. 

Now, for the compression of this inequality and others below, let the following be defined: 

z n 3 Ilk-Ill’, D“ +1 = Ilk"* 1 - fill’ + IIP? - ffflli. 

S- = IIP - r?|i;"lll’, E = If).' + + hk»-i + h 2 ft- -1 )||u°|| 0 ,] ! . 

With this notation, the following results after estimating cfc -1 |||t/ j (‘ — tf£||| 2 with (4.24): 

Z * +1 + cik~ x et l+1 D l + l + ek~~ x t l + x S l + x < (1 + ck + C 2 zkt*)Z l 
i - 1 

+c 4 ft 2 £ [k-'D” 1 * 1 + kZ m } + ckE + [ek-H l + e{l + c z t*) - c 0 ]S l 1 < / < n* - 1. 

m=l—l—fn 

Now, assume that e > 0 is chosen small enough that e(l + 03**) < co. In fact, if c < 0, suppose 
that for some c < 0, 1 + ck + c^ekt* < 1 + ck. Otherwise, if c > 0, take c > 0 in the following. Now, 
after summing the last inequality over !</<n<n* — 1, the result is: 

(Z n + X - Z l ) + efc“ 1 (t n+1 S n+1 - t x S x ) + cieJb“ 1 5^t ,+1 D ,+1 < ck^Z 1 

i=i i= l 

n /-I 

Y \ kzm + k- x D m + x } + ct* E 1 < n < n* - 1. 


By (4.14) and (3.31), for 1 < n < n* - 1: 


n l—l 


ckJ2z l + CAk'jrpj Z m <(c+ c 4 e o(m + l)t*)kJ2Z l + ckZ° < ck^Z 1 + ckE 


|=1 m=i- 1-jij 


where c < 0 if c < 0 and e 0 > 0 is small enough. Otherwise, take c > 0 in the following. Next, since 
(/ + l)/(m + 1) < /i + 2 if 0 < / - 1 - m < m < l - 1, it follows using (4.14) that for 1 < n < n* - 1: 


n /-I 


n l-l 


E Dm+1 < c 4 Jfc _1 eoEZ E -^-^t m+1 D m+1 ^cseok-'^t'+'D'+' + cD 1 . 

/= 1 m=l- 1-fH l=lm=l-l- fit m 1=1 

Combining the last three inequalities, for 1 < n < n* — 1: 

Z n+1 + ek~ 1 t n+1 S n+1 + ( Cl c - c 5 e 0 )Jk _1 E) t ' +l£)i+1 ^ ^ + eSl + cD *) + ct * E + gfc E Z • 


34 


By (3.6), (4.26), (4.25), (1.26) and (3.31): 

Z l + [S 1 + D 1 } < [ cD 1 + cZ°) + [S 1 + D 1 ] < c(l + k 2 )[Z° + E] + (1 + ck)S° < c{Z° + E) < cE. 
Now, assume that eo > 0 is chosen small enough so that: 


lfe n+I ||ln+l < «<*[('>' + ** + + ft 2 fc t,-1 )||« 0 ||a] 


1 + 5*£llk‘lll? 

J=0 


0 < n < n* - 1. 


If c < 0, ignore the last sum and (4.35) follows after (1.19). If c > 0, then (4.35) follows with the 
discrete Gronwall Lemma and (3.31), but with c* depending exponentially on t* . a 


5 Examples. 


The principal aim of this section is to present some computational results showing the strength 
of methods analyzed in this work. However, it is appropriate to first indicate that the set of 
IRKM’s which satisfy the many conditions imposed in foregoing proofs, is by no means vacuous. 
For example, in [15], it is explained that there exist g-stage methods of order q + 1 and satisfying 
(1.26)-(1.32) and (1.44), provided q = 1,2,3, or 5. Furthermore, [15] gives explicit constructions 
of families of such methods for q = 2 and 3. On the other hand, it is shown in [15], that for every 
positive integer q, there exists a collocation type IRKM satisfying (1.27), (1.29)-(1.32), and (1.44). 

As mentioned in the Introduction and more carefully in [15], the preferred methods in a parallel 
environment are those for which the eigenvalues of A are distinct. These have been referred to 
as multiply implicit (MIRK) methods. Further, they are called real if <x(A) C R, and otherwise 
complex. While the latter case has not been studied here, it is discussed in [15]. By considering 
that discussion together with the results of Bramble and Sammon [3], it can be seen that complex 
MIRK’s can be analyzed using quadratic preconditioning and hence inverse assumptions. 

In contrast to MIRK’s, there are the well-known methods for which the eigenvalues of A are 
identical and real. [12] As seen in (4.9), these so-called singly implicit (SIRK) methods offer a 
computational advantage on serial machines since at each time step, they require the formation of 
only a single new matrix with the dimension of Sh- A selection from this set of methods was made 
for the example considered below. 

The following problem is of the class defined in the Introduction: 


where: 


dtu = —L(t)u 

in (-1,1) x [0,.l] 

u = 0 

on {-1,1} x [ 0 , .1] 

u(x,0) = 1-x 2 

in (-1,1) 


L(t)u = -d x {ii{x, t)d x u ) + £q(x, t)u, 


4(x,t) 


^ Io g( 2 )(3-x 2 ) 
(2 + x 2 ) + t(l - x 2 ) 


(2 + x 2 ) t+1 , 


The solution is given by: 


t i(z,i) 


£o{x,t) = log (2 + x 2 ) - |log(2)(2 + x 2 )*. 

1-x 2 
(2 + x 2 ) r 
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k,h 

CPU Time (sec) 

Li error (xlO 9 ) 

Order 

1/50 

22 

1.19 


1/60 

30 

.525 

4.49 

1/70 

38 

.266 

4.42 

1/80 

48 

.148 

4.37 

1/90 

59 

.0889 

4.33 

1/100 

72 

.0565 

4.30 


Table 1: Modified method 


msm 

CPU Time (sec) 

Li error (xlO 9 ) 

Order 

1/50 

22 

28.5 


1/60 

31 

16.0 

3.16 

1/70 

41 

9.80 

3.19 

1/80 

52 

6.36 

3.23 

1/90 

65 

4.35 

3.24 

1/100 

77 

3.09 

3.24 


Table 2: Classical method 

For the spatial discretization, the Ordinary Galerkin Method was used and S'/, was constructed of 
smooth cubic splines defined on a uniform mesh. For the temporal discretization, the well-known 
three-stage diagonally implicit (DIRK) method was used as it satisfies (1.26)-(1.32). [8] 

Now let (1.46) be identified as the modified method, and an analogue based on (1.39) as the 
classical method. In addition, let a hybrid method be given by (1.46), but with D l replaced by T J in 
(1.35). These three methods were tested on the ICASE SUN 3/180. Defining E(h, k ) = ||£7£* — u n * ||, 
the Li errors E(k) = E(k,k) are reported in Tables 1-3, together with estimates of the convergence 
order obtained according to the formula: log(E(A: 2 )/E ! (A:i))/log(A: 2 /A:i). 

With regard to time consumption, recall that the computational burden for the classical method 


k,h 

CPU Time (sec) 

Li error (xlO 9 ) 

Order 

1/50 

23 

28.3 


1/60 

30 

15.8 

3.21 

1/70 

38 

9.61 

3.21 

1/80 

49 

6.25 

3.22 

1/90 

59 

4.28 

3.22 

1/100 

71 

3.04 

3.23 


Table 3: Hybrid method 
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is in forming q new stiffness matrices at each time step. On the other hand, with the constants 
{Oolm<^-i chosen in the natural way as indicated in the Introduction, the burden for the 
modified method is in forming the terms <£,• of (4.7), for the right side of (4.9). Also, the initial 
steps are relatively expensive, but the effect of this diminishes as the number of time steps increases. 
Note that among the three methods tested, numbers for the modified method were obtained with 
greater speed and accuracy, as well as with fourth order convergence. On the other hand, the 
others suffer from suboptimal convergence as explained in the Introduction. However, no rigorous 
explanation can be offered for the identical accuracy obtained by the classical and hybrid methods. 
Further, this author is unaware of any proof of the better than second order convergence seen in 
Tables 2 and 3. In this connection, note that the above solution has no time derivatives which are 
even in the domain of L(t) 2 , a condition considered necessary to escape order reduction in a general 
way. Nevertheless, only second order convergence is demonstrated for example, in Experiment 7.5.1 
of Dekker and Verwer [8], where a stiff ordinary differential equation is considered. Further, the 
modified method has been applied to this problem to give not only fourth order convergence, but 
accuracy exceeding that reported for any method discussed in the Experiment. 
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